Flexible Speech and Pen Interaction with Handheld Devices
نویسندگان
چکیده
An emerging research direction in the field of pervasive computing is to voice-enable applications on handheld computers. Map-based applications can benefit the most from multimodal interfaces based on speech and pen input and graphics and speech output. However, implementing automatic speech recognition and speech synthesis on handheld computers is constrained by the relatively low computation power and the memory limitations of these devices. This paper describes new results of our previous research on multimodal interaction using speech and pen inputs on handheld computers. Preliminary results show that combining speech input and pen gestures on handheld computers offers increased flexibility and improves naturalness and user satisfaction.
منابع مشابه
xstroke: Full-screen Gesture Recognition for X
Gesture recognition is a common method of text input on handheld and other pen-based computing devices. Xstroke is a full-screen gesture recognition program for the X Window System. The touchscreen of a typical pen-based device is divided into two regions, a primary region for application display and interaction, and a secondary region for gesture input. Full-screen gesture recognition improves...
متن کاملHype or Ready for Prime Time?: Speech Recognition on Mobile Handheld Devices (MASR)
The pervasiveness of mobile handheld devices and advancement in real-time continuous speech recognition technology has opened up a wide range of research opportunities in human-computer interaction for those devices. On the one hand, there has been an increasing amount of research on developing user-friendly speech recognition solutions and applications for mobile handheld devices. On the other...
متن کاملMatch: Multimodal Access to City Help
Interfaces to mobile information access devices need to allow users to interact using whichever mode or combination of modes are most appropriate, given their user preference, task at hand, and physical and social environment. This paper describes a multimodal application architecture which facilitates rapid prototyping of flexible nextgeneration multimodal interfaces. Our sample application MA...
متن کاملMultimodal Database Access on Handheld Devices
We present the final MIAMM system, a multimodal dialogue system that employs speech, haptic interaction and novel techniques of information visualization to allow a natural and fast access to large multimedia databases on small handheld devices.
متن کاملPower Email: Efficient Email Entry on Pen-Based Handheld Devices
Email access from handheld devices is cumbersome, partly because of the considerable effort in entering text using pen-based devices. Even though much research has been done on improving text entry speed on handheld devices, little research has been done on text entry for e-mail messages. In this paper, we utilize the user knowledge and application semantics of email to enable easy and fast ema...
متن کامل